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The paper gives an example of a tree language G that is recognised by an unambiguous parity au- 
tomaton and is E[ -complete (analytic -complete) as a set in Cantor space. This already shows that the 
unambiguous languages are topologically more complex than the deterministic ones, that are all in 

nj. 

Using set G as a building block we construct an unambiguous language that is topologically 
harder than any countable boolean combination of E} and n[ sets. In particular the language is 
harder than any set in difference hierarchy of analytic sets considered by O. Finkel and P. Simonnet 
in the context of nondeterministic automata. 

Introduction 

Topological complexity becomes more and more popular as a set complexity measure in theoretical 
computer science, especially in automata theory. Understanding how hard from the topological point of 
view are the languages recognised by a particular class of automata gives us more understanding of the 
power of those automata. It also gives us the access to very powerful and well developed tools coming 
from descriptive set theory. 

One of remarkable uses of descriptive methods is the separation of classes of languages. Once we 
know the upper complexity bound for a given class, we can use it while showing that some languages 
do not belong to the class. To quote only recent applications of this method, it was used in H to show 
that deterministic max-automata are less expressive than nondeterministic ones. In fTTl, topological 
complexity methods were used to exclude a large class of automata as a potential automata model for 
MSO-fU logic. 

In this paper we address this complexity question for unambiguous automata on infinite binary trees, 
i.e. nondeterministic automata that have at most one accepting run on each tree. With a rise and develop- 
ment of models of automata that do not admit determinisation (infinite tree automata, register automata, 
BC-automata [5], etc.), the notions like unambiguity, and strong unambiguity, that can be seen as less 
restrictive variants of determinism, gain the importance. For the survey on forms of determinism see ||9l- 

It is well known that deterministic parity tree automata recognise only sets in 11} topological class 
(coanalytic sets). On the other hand, nondeterministic automata recognise some sets that are neither 
analytic, nor coanalytic, but their expressive power is bounded by the second level of the projective 
hierarchy. By Rabin's complementation result ([17]), all nondeterministic languages are in A\ class, i.e. 
are both ^rid ^2- 

It was shown by Niwiriski and Walukiewicz in ifTSl] (later described in fTl and Jll) that unambiguous 
automata do not recognise all nondeterministic languages. On the other hand, it is not hard to see that 
they are more expressive than deterministic automata. An example here might be language UB of trees 
that have exactly one branch with infinitely many labels a. 
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Language is a Ilj complete set. However, deterministic automata are also capable of recognising 
some n} complete sets. Until now it was not known whether unambiguity introduces any hardness 
versus determinism from the topological viewpoint. Because UB seems to be typical and close to the 
very definition of unambiguous automata, it has been widely believed that this example reflects the 
maximum power of unambiguity. 

In this work, in Section [2j we show an example of unambiguous language G that is £} complete, 
hence is not in IT}. Then, in Section [s] using G, we construct another unambiguous language that is 
topologically harder than any set obtained from £} and 11} sets by countable boolean operations. As a 
consequence, the language itself is not such a boolean combination. At this level of granularity, this is the 
most that we can have in locating unambiguous class between deterministic and nondeterministic classes. 
To find out if there is a difference in topological complexity between nondeterministic and unambiguous 
languages we would have to refer to more precise complexity measures than just the projective hierarchy, 
e.g. to the finest one - the Wadge hierarchy. 

In Section[4]we show that the example from Section|3]is actually strongly unambiguous, i.e. unam- 
biguous together with its complement. 

The full version of the paper with Appendix containing a proof of one general topological fact can 



be found onhne at: http://www.iiiimuw.edu.pl/~shummel/uiiamb_topol.pdf 



1 Preliminaries 

Let A be an arbitrary set of labels. An infinite binary tree over A is a function t : {I, r}* — )• A. By TX we 
denote the set of all infinite binary trees over A. For t ^ Ta and v G {l,r}*, we use a notation ty for the 
subtree of t rooted in v, i.e. ty{w) =t{v-w). 

1.1 Automata 

A (nondeterministic) parity tree automaton over an alphabet A consists of a finite set Q of states, a 
transition relation SCgxAxQxQ, an initial state q{) G Q, and a ranking function rank : 2 — )• ft). We 
depict a transition {q,a,q\,q2) as: 




A run p of the automaton on a tree f is a labelling of the tree with states (p : r}* — 2) consistent with 
the transition relation, i.e. for each node v G the tuple (p(v),f(v),p(vZ),p(vr)) belongs to 5. We 

additionally require that the root of t is labelled with an initial state q^. The run is accepting if on each 
branch of the tree the highest rank occurring infinitely often in the run is even (the parity condition). 

As usual, the language recognised by an automaton is the set of all trees on which the automaton has 
some accepting run. 

The automaton is called (top-down) deterministic if its transition relation is in fact a function 8 : 
2 X A — >• 2 X 2. An important property of deterministic automata is that they have exactly one run 
on each input. A similar property gives a rise to consideration of a wider subclass of nondeterministic 
automata: 

The automaton is unambiguous if it has at most one accepting run on each input. In other words, if 
it accepts a given tree, it can do it in only one way. 
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Since in a parity automaton the set of states is finite, so is the set of used ranks (the image of the 
ranking function). We say that the automaton is of index (i, K") G ft) x o) if i < rank(2) < K. Since 
shifting all ranks by an even number does not change the language recognised by the automaton, it 
suffices to consider indices (i, K") for i G {0, 1}. We say that the language is of index (i, k) if there 
is an automaton of such index recognising this language. By identifying each index with the class of 
languages of this index we obtain the Rabin-Mostowski index hierarchy. Lines denote inclusion on the 
diagram of the hierarchy shown on Figure [T] 

(0,0) (0,1) (0,2) 

X X : 

(1,1) (1,2) (1,3) 




Figure 1 : The Rabin-Mostowski index hierarchy. 



The inclusions come immediately from the definition — only in some cases we need to shift ranks of 
corresponding automata by 2. Two classes (indices) at the same level of the hierarchy (levels are vertical 
on the diagram) are called dual, and by (i, k) we denote the class (index) dual to (i, K"). 

Automata of index (1,2) are called Biichi automata. 

If nondeterministic parity automata are considered we talk of nondeterministic index hierarchy. An- 
other often considered and very important variant is alternating index hierarchy. Since we will refer also 
to this hierarchy, we need to recall shortly the definition of alternating automata. 

An alternating parity tree automaton is similar to the nondeterministic one with the exception that 
the set of states is partitioned into two parts 2 = U 2v- The semantics of such an automaton is 
defined by the game between two players 3 and V. During a play in this game players construct a run 
of an automaton in a top-down manner. If a given node was labelled by the state from 2^ during this 
construction then the next transition is chosen by Player 3, otherwise it is chosen by Player V. The play 
is won by Player 3 if in the constructed run on each branch the parity condition holds. A tree is accepted 
by the automaton if Player 3 has a winning strategy in the game defined by this automaton on this tree. 

The immediate, but important, fact concerning alternating automata in the context of index hierarchy 

is: 

Remark 1.1 If a language is of alternating index (i , k) then its complement is of alternating index (i , k). 
Proof: 

It is enough to switch players and shift ranks by one in the automaton recognising a given language. 

□ 

The crucial fact about the hierarchies is that they are strict, i.e. all inclusions on Figure [T] are strict. 
This result for nondeterministic hierarchy is due to Niwiriski 1. 14,1 . For alternating hierarchy it was 
independently proven by Arnold HI and Bradfield . 

Theorem 1.2 (Niwinski, Bradfield, Arnold) For infinite binary trees, both alternating and nondeter- 
ministic index hierarchies are strict. 

The languages recognised by nondeterministic (or equivalently alternating) tree automata are called 
regular tree languages. The languages recognised by deterministic (respectively unambiguous) automata 
are called deterministic (respectively unambiguous) tree languages. 
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1.2 Topology 

For a fixed alphabet A, we treat 7^ as a topological space. A basic open set is obtained by fixing a finite 
prefix of trees (a finite tree starting in the root). Other open sets are obtained by taking arbitrary unions 
of basic open sets. If A is finite, this topological space is homeomorphic (i.e. topologically isomorphic) 
to the Cantor space. 

1.2.1 Projective hierarchy 

The class Bor{X) of Borel sets in the topological space X is the least class that: 

• contains all open sets of X, 

• is closed under complementation, and 

• is closed under countable unions and intersections. 

If a space is understood from the context the class is simply denoted by Bor. 

The class of Borel sets is not closed under projection. Each set that is a projection of a Borel set is 
called analytic. The class of analytic sets is denoted by £[. Formall)|^ 

^l(^) = {P'^X : ^A-fimte^BeBor{X xTa) P=^l{B)} 

The rest of the projective hierarchy is defined as follows: 

IT- consists of the complements of the sets from Z] 
r?^j consists of the projections of the sets from 11- 

The sets from the class 11} are called co-analytic. 

An important theorem of Souslin states that if a set is analytic and co-analytic, then it is Borel. 
In the sequel we will also use two kinds of intermediate classes. The first kind is: 

The second one is the a-algebra generated by the sets at given level. Recall that the cr-algebra (also called 
C7-field) generated by a family A is the closure of the family on countable union, countable intersection 
and complementation. 

Figure |2] present the shape of the projective hierarchy. All the inclusions on the diagram are strict 
(apart from the leftmost equality coming from Souslin's Theorem). Proofs of all the facts mentioned in 
this section can be found in |[T2l Chapters 14 and 37]. 

1.2.2 Topological Complexity 

A class of subsets of topological spaces is a topological complexity class if it is closed under preimages 
of continuous functions. In particular any class depicted on Figure |2] (if we do not fix any specific 
space) is a topological complexity class. Analogously to the complexity theory, there are the notions 
of reductions and completeness. Let X and Y be two topological spaces and let A' C X and M CY. A 
continuous function / : X — )• F is a reduction of A" to M if K=f^^{M). In such case we say that K is 
Wadge-reducible to M, or that M is topologically harder (more complex) than K. 

For a topological complexity class K, a set M is called K-hard if any set A' G K is Wadge-reducible 
to M. We say that M is K-complete if additionally M G K. 

'The choice of space 7^ at the second coordinate is not a commonly made choice in this definition, but it is best suited for 
our needs and the resulting notion is the same as in the standard definition. 
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Figure 2: The projective hierarchy 



1.3 Topological Complexity of Automata 

We recall some basic facts binding automata and index hierarchies with topological hierarchies. We use 
these facts in further discussion. 

Theorem 1.3 Each regular language of infinite trees is in K\. 
Proof (sketch): 

For a fixed branch a of an infinite tree, the set of runs for which the parity condition on a holds, is 
Borel. Therefore, the set of accepting runs is a n} set — "for all branches" corresponds to co-projection. 
Now, for a fixed nondeterministic parity automaton, the accepted trees are the ones for which there exists 
an accepting run, so the recognised language is a projection of Ilj set. 

By Rabin's complementation lemma (see I.17J ). the complement of the language recognised by a 
nondeterministic automaton is also recognised by a nondeterministic automaton. If a language and its 
complement are both 1^ sets, they are in fact sets. □ 



Theorem 1.4 Each language recognised by a deterministic parity tree automaton is in Yl\. 
Proof (sketch): 

Each deterministic automaton defines a continuous function mapping a tree to the run on it. The set 
of accepted trees is, then, the inverse image of the set of accepting runs under a continuous function. The 
set of accepting runs is IT} , then so is the recognised language. □ 



Theorem 1.5 Each language recognised by alternating parity automaton of index (1,2) ( resp. (0, 1 )) 
in r{ (resp. Yl\) topological class. 

Proof: 

It was shown by Arnold and Niwiriski fT\ that each language of alternating index (1,2) can be recog- 
nised by a nondeterministic automaton of index (1,2) (a Biichi automaton). Rabin proved in [18] that 
each such language can be described by existential formula of monadic logic. This implies that they are 
analytic (Z}). 

The fact for index (0,1) comes from the duality — alternating (0,1) automata recognise complements 
of sets recognised by alternating (1,2) automata (see Remark [lT] ). □ 
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2 Analytic Complete Language 

The result presented in this section was inspired by the unpublished work of BiUcowski on the decidability 
of Unambiguity Problem [31, and by the decidability result presented by Niwiriski and Walukiewicz in 
lfT6l . Bilkowski has shown that the complement of a deterministic language is unambiguous if and only 
if the language is recognised by a thin automaton, i.e. by an automaton that has only countably many 
non-trivial paths in each accepting run. A path is trivial if, from some moment on, it is labelled only by 
all-accepting or all-rejecting states. 

The deterministic automaton recognising the complement of language G described below is thin in 
Bilkowski's sense, and has split property — the sufficient condition for the 11} hardness from the result 
of fl6J . We do not give precise definitions, nor do we discuss the above results since the proofs in this 
article do not rely on them — they were only used while constructing the example presented in this 
section. 

We call a branch of a binary tree over the alphabet {a, b} good if: 

1. it is labeled only with a's, 

2. it turns left infinitely many times. 
Let: 

G = {t € T[a.b} • t has a good branch} 

First, we prove the crucial lemma: 

Lemma 2.1 If an infinite binary tree over the alphabet {a, Zj} has a good branch, then it has the left-most 
such branch, i.e. a good branch such that there is no good branch to the left. 

Proof: 

Assume that a tree t has a good branch. The construction of the left-most good branch goes as 
follows. We start from the root. If we have constructed the prefix of the branch up to the node v we 
advance to the left descendant if there are good branches going through it. Otherwise we advance to the 
right descendant. Call the branch constructed by this procedure p{t). 

By the construction, it is clear that there is no good branch to the left from p{t). Now we prove that 
p{t) is good. Note that during the construction we maintain the invariant that there is a good branch 
going through a considered node. In particular, all nodes we have selected are labeled with a, therefore, 
we only need to verify property |2] from the definition to proof goodness of p{t). 

Assume that p(f) turns left only finitely many times. Then there is a vertex v on the branch p{t) after 
which p{t) turns only right. Let us take a good branch going through v, and call it a. By the assumption, 
p{t) is not good, so branches p{t) and a diverge in some vertex w. Since w is below v, p{t) goes right 
from w and a goes left. Since a is good, the construction should have selected the left descendant of w, 
but have selected the right one. That yields a contradiction, so p{t) turns left infinitely many times. □ 

Now let L = G. 

Proposition 2.2 Language G is recognised by an unambiguous automaton and its complement L is 
recognised by a deterministic automaton. 

Proof: 



Thanks to Lemma 2.1 to prove unambiguity of G it is enough to show an automaton that guesses 
the left-most good branch and verifies correctness of the guess. The idea is that automaton goes along 
a branch labelled with a's, proving that the branch turns left infinitely many times, and proving that 
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everything that diverges to the left from the branch does not have a good branch (i.e. belongs to L), and 
not caring what happens to the right from the branch. 

Let us then start with constructing a deterministic automaton recognising L.It has 3 states: states 
Iq and l\ (subscript indicates rank) occur on paths that have had only a's so far, and track turns to the 
left; state To is all-accepting (i.e. self-looping with rank 0). Initial state is Zi and the transitions are as 
follows: 



lip 




^0 To To 

The automaton uses ranks {0, 1}. Note that, for given tree t, the run of ^ on f has a branch with infinitely 
many ranks 1 on it if and only if there is an a-labelled branch turning left infinitely often in t. Therefore 
the automaton recognises L. 

The automaton §f for language G uses ^ as a component. It has 7 states and uses ranks 0, 1,2. 
States g\ and g2 (again, subscript indicates rank) are used to track the branch; states of — to prove 
non-existence of a good branch in a subtree; state T2 is all-accepting, and state Ti is all -rejecting. The 
initial state is gi. The automaton uses the following transitions: 



L-part 




It is not hard to see that presented automaton implements described idea, therefore accepts if and 
only if given tree has a good branch. It is unambiguous, because it only can accept by labelling the 
left-most good branch with g states. □ 



Remark 2.3 Automaton ^ is of index (0, 1), and is of index (0,2). 

Note that automaton ^ can be transformed into an equivalent one of index (1,3), by making L-part 
use ranks {2,3} instead of {Q^ 1}. 

Proposition 2.4 Set G is'L\ complete. 

Proof: 

To prove the hardness we continuously reduce the set IF of ft)-branching trees with an infinite branch 
to our set G. Set IF is a well known £} -complete subset of the space Tr of trees on (O, i.e. prefix-closed 
subsets of (O* (see e.g. |[T2l Theorem 27.1]). The topology on Tr is similar to the one on 7^: a basic 
open set is obtained by fixing some finite part of trees. E.g. for some integer n, we fix what nodes out of 
{1, belong and what do not belong to all trees in a set. 

We construct a reducing function / : Tr — > Ts^^ i^y Fix a tree t € Tr. Put labels a to the root and all 
right descendant nodes in the tree f{t). For each node ?ii?i2'^3 • • of tree t we put label a to the node 
r"^lr"^lr'^^l . . .r'^'^l in f{t). Remaining left descendant nodes obtain label b. 

Note that f{t) has an a-labelled branch that turns left infinitely many times (i.e. a good branch) if 
and only if t has an infinite branch. Therefore 
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So / indeed reduces IF to G. 

Function / is continuous, because the labels at n'th level of the tree f{t) are determined by the finite 
part of a tree t , namely the part in { 1 ,...,«}-" . 



The upper topological complexity bound of set G comes from Proposition 2.7 that will be proven 



later, and from Theorem ] 1 .51 □ 

Therefore, we have proven the following: 

Theorem 2.5 There is a £{ complete language of infinite trees, that is recognised by an unambiguous 
parity automaton. 

Recall the theorem that is stated as Corollary 4.14 in flOl: 

Theorem 2,6 (Finkel, Simonnet) A tree language recognised by an unambiguous Biichi automaton is 
Borel. 

Thanks to this theorem we know that no unambiguous Biichi automaton recognises language G. 
Proposition 2.4 implies that G is not a IT} set, therefore, by Theorem 1.5 it cannot be recognised by any 



(even alternating) automaton of index (0, 1). As a result we obtain that the use of 3 priorities is necessary 
for unambiguous automaton to recognise G. On the other hand observe that: 

Proposition 2.7 Language G is recognised by a nondeterministic Biichi automaton. 

Proof: 

It suffices to remove L-part from the unambiguous automaton W presented in the proof of Proposition 
|2.2[ replacing /i with T2 in other transitions to obtain needed nondeterministic automaton. The only 
purpose of that part was to make sure that we select left-most good branch. We do not need this if we do 
not care about the number of accepting runs. □ 

From this observation we obtain that the result by Finkel and Simonnet is tight in the sense that the 



following strengthening of Theorem 2.6 does NOT hold: "An unambiguous language that is recognised 



by some (possibly ambiguous) nondeterministic Biichi automaton, is Borel". Let us state it as follows: 

Corollary 2.8 There is a language of non-Borel topological complexity that is on one hand unambigu- 
ous, and on the other hand Biichi. 



3 Beyond Boolean Combinations 

In this section we construct an unambiguous tree language that is topologically harder than any set in 
a{t[). For that we need to prove that the class of the sets that reduce to the constructed language contains 
all analytic sets, and is closed under complementation and countable unions. 

The construction of the language harder than boolean combinations of analytic sets goes through an 
automaton. The automaton, we will call it uses as building blocks: 

1. the unambiguous automaton ^ recognising language G from Section|2j 

2. the deterministic automaton ^ recognising L := G. 

Since we will work with larger alphabet than just {a,b}, we modify the automata (and recognised lan- 
guages), such that they treat all letters except of a like b. After this modification, the languages recognised 
by the automata are complements even in case of larger alphabet. 
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The idea is that automaton 'tf expects the part of a tree near the root to be shaped as a formula defining 
some set in the a-algebra C7(£}). Countable union is represented by the branch turning only left, where 
right descending subtrees correspond to subformulas. Complementation nodes in a way disregard the left 
descendants. In nodes corresponding to the atoms of the formula (analytic sets) the automaton expects 
subtrees from language G. The details follow. 

The automaton ^ works over the alphabet A = {a,ft,V,-i}. Apart from the states of the automata ^ 
and Jf, it uses states: A'^, P, A^v^ A/^ Ty, T5, T (P stands for 'Positive', A'^ for 'Negative'; Ty and T5 
serve only verifying the shape of the formula). The initial state is P. The transitions of ^ are as follows: 




Tv P Pv N Ny N Tv Ts 

N P Ts Ts 




where T is an all-accepting state. Additionally, when the automaton encounters letter a or ^7 in state P, it 
starts to act as automaton ^. If it encounters one of these letters in state A^, it starts to act as automaton 

States A'^, P, P\/, T5 have rank 1, states N\j, T'^,T rank 0. 

Note that automaton ^ is of index (0, 2) — it is because of ranks used by 

We will use the notation for the automaton ^ modified in such a way, that q becomes an initial 
state. Let us prove the following: 

Proposition 3.1 For each set S C.X obtained from analytic sets by countable boolean operations the 
following holds: 

there is a continuous function f :X Ta, that simultaneously reduces S to L{^), ' 
and S to L{^n), i.e.: 

1. ^ accepts f(x) iffx G 5, 

2. '^Nacceptsf{x)iffx^S. H*^ 
Additionally we require: 

3. For all x, "^j^ accepts f{x). 

Proof: 

We need to prove that the class of sets for which the property (*) holds contains all analytic sets, and 
is closed under complementation and countable unions. 

(analytic sets) Take an arbitrary analytic set 5 C Z. Since G is analytic-complete, there exists a contin- 
uous function f :X ^ 'P{a,h} reducing S to G. We will show that the same function is actually a needed 
simultaneous reduction to L{^) and L{^i^). 

Note that among the trees over the alphabet {a^b}, ^ accepts exactly the trees from G. Therefore: 



/(x)GL(^) 



f{x) G G 
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Now we have to show that accepts f{x) from state if and only if x ^ S. Recall that from state A^, 
on trees over {a,b}, ^ acts exactly like automaton ^ . Since ^ recognises the complement of G, we 
obtain the statement. 

From state T5 each tree with a or in the root is accepted, so condition [3] also holds for /. 

(closure under the complement) Take any set 5 C X for which (*) holds, and let / : X — be an 

appropriate reducing function. We construct a reduction / : X — )• 7a of 5 to L{^) by putting: 




(the rest of the leftmost branch does not matter) 



By the inductive assumption and by the shape of the transitions over letter we obtain that f(x) is 
accepted from state P if and only if f(x) is accepted from state N, that f(x) is accepted from state if 
and only if f{x) is accepted from state P, and that fix) is accepted from state T5 if and only if fix) is 
accepted from state T^. 

(closure under unions) Take a set 5 C X such that S = [J'^^qSi, where each Si has property (*). For each 
/, let /,■ : X — )• 7a be an appropriate reduction as in (*) for set Si. We build a reduction for set S as follows: 




Function / is clearly continuous. We now prove that it is a needed simultaneous reduction. 

Let X £ S, and let /q be the least / such that x G Si. Then, from the inductive assumption: is 
accepted from state P; for each / < io, fi{x) is accepted from state A^; for each / > /q, /i(^) accepted 
from state Tj. Then, by the shape of the transitions over label V, f{x) is accepted from state P. 

Let now x ^ S. Then x ^ Si for each /. Therefore, for each /, fi (x) is accepted from state A'^. Then 
/(x) is accepted from state A^, by the shape of transitions over V. 

If each /,(x) is accepted from state T5, then by the shape of the transitions from T5 and Ty over V, 
/(x) is also accepted from state T5. □ 

In particular we have proven: 

Corollary 3.2 Each set from cj(r}) continuously reduces to L(^). 

We use one more fact from descriptive set theory. It can be proven using Theorems 1E.3, 1D.2, ID. 3 
from ifTSl and the fact that cj(r} ) is closed under the complement (the details can be found in Appendix 
of the full version of this paper). 
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Proposition 3.3 For each n>\, there is no o{L]^-complete set. 

Corollary 3.4 Set L(^) is in ^\ \ o{Z\ ). 

Let now W C 7a be the language of trees corresponding to improperly shaped formulas, i.e. the set 
of trees that: 

1. contain a branch labelled only with V and that turns right infinitely many times, and turns right 
after each occurrence of (formula is not well-founded), 

or 

2. contain a path from the root that turns right after each occurrence of ends in a left descendant 
node V that is labelled with something different than V, a parent of v is labelled with V, and all 
nodes above v are labelled with V or 

Lemma 3.5 Sets L(^), L('^) and W constitute a partition ofT^. In particular L{^) and L{'^i^) are 
disjoint. 

Proof: 

First we show that if ? G VK, then t is not accepted from neither of states P, N. Assume first, that t has 
a branch p as in point [T] of the definition of W . Consider a run of the automaton starting from P or N. 
Branch p is labelled with states N, P,Ny, Py, Ty, T s (ranks and 1) in this run, and after each turn to 
the right there is state N, P, or Tj (each of rank 1). The highest rank occurring infinitely often on branch 
p is 1, so the run is not accepting. Now assume that t has a path as in point|2]of the definition of W . In a 
run starting from P or N, the node v, as a left descendant of a node labelled with V, always obtains a state 
label of Ny, Py, or Ty. Since from these states there are only transitions over letter V and v is labelled 
with something different, the run gets stuck. 

Let us now consider well-shaped trees, i.e. trees outside W. Recall that prefixes of such trees rep- 
resent well-founded formulas. Using this fact we define a rank on such trees. For a tree t, rank(f) is an 
ordinal defined by the rules: 

• If the root of t is labelled with a or b, then rank(f) = 0. 

• If the root is labelled with then rank(f) = rank(fr) + 1, where t,- is a subtree of t rooted in right 
descendant node of the root. 

• If the whole left-most branch is labelled with V, then rank(f) = sup{Tank{tii'r) + 1 :n> 0}, where 
f/n,. are subtrees diverging from the path to the right. 

Note that the above set of rules allows to define the rank for all well-shaped trees. 

Now we prove by the transfinite induction on rank(f) that each well-shaped tree t is either accepted 
from state P or from A'^, but not from both. 

If rank(f) = 0, the tree has a or ^ in the root. It is, then, accepted from state P if and only if f G G, 
and is accepted from state N if and only if f G L. Since L is the complement of G, we are done with this 
case. 

If rank(f) > 0, then the root is labelled with V or If it is labelled with then t is accepted from 
state P if and only if t,- is accepted from state N, and vice versa. Since tr is of lower rank than t, it suffices 
to use the inductive assumption for tr- 

If t has label V in the root, then, since it is well-shaped, it has label V at whole left-most branch. 
All subtrees diverging to the right from the left-most branch have lower rank then so we can use the 
inductive assumption for them. Then: 
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either at least one of the subtrees is accepted from state P and not from — in this case t is accepted 
from P, but not from N, 

or each of them is accepted from state N and not from P — then tree t is accepted from state N, but 
not from P. 

□ 

Proposition 3.6 Automaton is unambiguous. 
Proof: 

The only nondeterminism in automaton occurs in state P (or Py) and label V. Two transitions are 
possible from this configuration — one assigns state P to the right child, the other one assigns state N to 
the right child. By Lemma [33} only one of the transitions can be used in an accepting run from a given 
node in a given tree. □ 

Recall that automaton is of index (0,2). Since L(^) is neither a Zj set, nor a Yl\ set, by Theorem 



1.5 we have: 



Remark 3.7 Language L{^) cannot be recognised by any alternating automaton using 1 ranks ( neither 
(0,1), nor (1,2)). 

4 The Example Is Strongly Unambiguous 

A language M is called strongly unambiguous if both M and M are recognised by unambiguous automata. 
Because of the apparent asymmetry of the class of unambiguous languages, strong unambiguity seems 
to be an important notion. Some arguments for its importance were given by Colcombet in [9j|. 
In this section we prove that the example from Section[3]is actually strongly unambiguous. 

Proposition 4.1 The complement of language L[^) is recognised by an unambiguous tree automaton. 

Proof: 

Recall that, by Lemma 



3.5 



L{^) is the disjoint union of W and LCtf^). Since the class of unambigu- 
ous languages is closed under disjoint unions, and '^at is an unambiguous automaton, we only need to 
show how to recognise incorrectly shaped trees unambiguously. It can be done by finding the rightmost 
incorrect branch. The proof that the rightmost incorrect branch exists is analogous to the proof of Lemma 
ED 

The automaton uses states B, B\/, Ts, Tv, T. States B and By are used to track the branch and T5 
serves showing non-existence of incorrect branch in a subtree. State B is of rank 2; T5 and B\/ of rank 1; 
the remaining states are of rank 0. The initial state is B. The transitions are as follows: 




as in 




Tv,T5 Ts 






A 


















^\ 
T T 
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where —V is any label different than V. 

Each run of the automaton has exactly one branch that is labelled (whole or up to some node) with 
states B and Sy. The ranks of the branch fulfill the parity condition if a node with label different than 
V occurs as a left descendant of a V-node — then the branch is as in point 2 of the definition of set W; 
or if it turns right infinitely many times and is whole labelled with V or — then it reflects point 1 of 
the definition of set W. The subtrees diverging to the right from the branch are well shaped — as in 
automaton Tg guarantees this. Therefore, the automaton is unambiguous — the right-most incorrect 
branch has to be selected. □ 

The following theorem summarises the topological results of this paper: 
Theorem 4.2 There is a strongly unambiguous tree language that is not in o{JL\ ) class. 

5 Related Work 

In ifTOl the authors consider the difference hierarchy of analytic sets. They show a sequence of regular 
tree languages hard for the levels Da{^\) of the hierarchy, for a < co"'. Then, on page 10, they note that 
the languages (even the first one in the sequence) are not recognised by unambiguous tree automata. 
The base for the construction of Finkel and Simonnet is the set: 

{t G 7{o i| : there is a branch in t with infinitely many labels 1} 

If we look at the construction there, we see that we can use unambiguous set G from this paper as 
a base, and hardness results still hold. Actually the proofs remain exactly the same, since they only use 
E} -hardness of the basic set. 

Now we note that each automaton built during the construction is unambiguous if we use unam- 
biguous automaton W recognising basic set G and unambiguous automaton recognising its com- 
plement (i.e. set L from Section [2]) as basic building blocks. Indeed, for given tree t, the automaton 
described in the proof of Lemma 4.5 in lUOll always selects the path corresponding to the smallest ordinal 

w"^^ ■ + (o"^ ■ an-2 H h CO • ai +ao for which the tree f/''„-i,-/''n-2r - r/"o belongs to G, and proves 

that all paths corresponding to less ordinals end up in something that does not belong to G (i.e. belongs 
to L). Unambiguous automaton is used to verify belonging to G and .=Sf is used to verify belonging to 
L. 

As a result, using example languages G and L from this paper and the construction from the paper 
ifTOl by Finkel and Simonnet, we get a sequence of unambiguous languages hard for the classes Da(£}), 
for a < co^. We give this fact here only as a note, because all the languages in the sequence reduce to 
the language from Section |3] This is because each set at any countable level of the difference hierarchy 
of analytic sets is, by the definition, in cj(£}). 

We add a note by an anonymous reviewer. The game tree language lV(o 2) (one of the languages used 
in m to show strictness of alternating index hierarchy) does not belong to the class cj(r}), which is an 
answer to the question asked in the last paragraph of lITOll . Indeed, language L(C) is of index (0,2) and 
thus is Wadge -reducible to language W(o,2) by the result cited in ifTOl Lemma 5.2]. 
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